A Hadoop cloud-based surrogate modelling framework for approximating complex hydrological models
نویسندگان
چکیده
Abstract Hydrological simulation has long been a challenge because of the computationally intensive and expensive nature complex hydrological models. In this paper, surrogate modelling (SM) framework is presented based on Hadoop cloud for approximating The substantial model runs required by design experiment (DOE) SM were solved using cloud. Polynomial chaos expansion (PCE) was fitted verified high-fidelity DOE then used as case study to investigate approximation capability in Soil Water Assessment Tool (SWAT) with regard accuracy, fidelity, efficiency. experiments, reduced computation time approximately 86% when global sensitivity analysis. PCE achieved results equivalent those standard Monte Carlo approach, flow variance coefficient determination 0.92. Moreover, proved be reliable approach but significantly more efficient. proposed greatly decreases computational costs through computing modelling, making it ideal optimization.
منابع مشابه
Hadoop Based Enhanced Cloud Architecture
Explosion of biological data due to largescale genomic research and advances in high throughput data generation tools result in massive distributed datasets. Analysis of such large nonrelational, heterogeneous, and distributed datasets is emerging challenge in data driven biomedical industries. Highly complex biological data require unconventional computational approaches and knowledge-based so...
متن کاملApproximating nonequilibrium processes using a collection of surrogate diffusion models.
The surrogate process approximation (SPA) is applied to model the nonequilibrium dynamics of a reaction coordinate (RC) associated with the unfolding and refolding processes of a deca-alanine peptide at 300 K. The RC dynamics, which correspond to the evolution of the end-to-end distance of the polypeptide, are produced by steered molecular dynamics (SMD) simulations and approximated using overd...
متن کاملA General Framework for Agent-based Modelling of Complex Systems
Agent-based approaches to modelling complex systems and phenomena are becoming popular and are proving successful in a number of areas. However, the underlying basis of these techniques is sometime rather 'ad-hoc' and the models are often only applied to specific systems. This paper describes a general approach that is based on the use of fully general computational models, using a formal model...
متن کاملA framework for development and application of hydrological models
Many existing hydrological modelling procedures do not make best use of available information, resulting in non-minimal uncertainties in model structure and parameters, and a lack of detailed information regarding model behaviour. A framework is required that balances the level of model complexity supported by the available data with the level of performance suitable for the desired application...
متن کاملA Query Processing Framework based on Hadoop
With the development of cloud computing and big data, the massive volume of dataset proposes a big challenge for cloud data management systems. Unlike traditional database management method, cloud data queries are typically parallel and distributed. Intuitively, the query processing framework should embrace these characteristics. In this paper, by leveraging the inherent data structure of Hadoo...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of Hydroinformatics
سال: 2023
ISSN: ['1465-1734', '1464-7141']
DOI: https://doi.org/10.2166/hydro.2023.184